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Abstract 

We study the absolute continuity of the convolution 5^x of two orbital measures on 
- - - the symmetric space SOo(p, g)/SO(p) x SO{q), q > p. We prove sharp conditions on X, 

. Y £ a for the existence of the density of the convolution measure. This measure intervenes in 

I the product formula for the spherical functions. We show that the sharp criterion developed 

CN ■ for SOo(p, (7)/SO(p) x SO{q) will also serve for the spaces S\J{p,q)/S{\J{p) x \J{q)) and 

J> . Sp(p, q)/Sp{p) X Sp(g'), q > p. We also apply our results to the study of absolute continuity 

^ ! of convolution powers of an orbital measure d'lx ■ 

o: 

1 Introduction 

. The spaces SOo(p, g)/SO(p) x SO(g) where q > p (which we will assume throughout the paper), 
I are the noncompact duals of real Grassmannians. They are Riemannian symmetric spaces of 
I noncompact type corresponding to root systems of type ====^Bp'^====. The harmonic 
^ I analysis on these spaces has been intensely developed in recent years ( [U [T31 [TH US] ) . 

We use throughout the paper the usual notations of the harmonic analysis on Riemannian 
symmetric spaces. The books [9l [10] constitute a standard reference on these topics. 
^ . Let X, Y G a and let tuk denote the Haar measure of the group K. We define 5^^^ = 

CN '. rriK * 5f,x -k niK- The question of the absolute continuity of the convolution 5^x * of two K- 
invariant orbital measures that we address in our paper has important applications in harmonic 
O i analysis itself (the product formula for the spherical functions) and in probability theory (random 
^ ■ walks, Jo characterization of Gaussian measures). 

The spherical Fourier transform of the measure 5\ is equal to the spherical function (j)x{e^), 
where A is a complex-valued linear form on a. Thus the product (f)\{e^)(f)x{e^) is the spherical 
Fourier transform of the convolution mx,Y = ^^.x '*^^\y- If we denote by ^x,y the projection of the 
measure nixx on a via the Cartan decomposition G = KAK, then 



(N 



0A(e^)0A(e^)= / Me'')dfXx,YiH). 
J a 



Let 6 be the density of the invariant measure on o in polar coordinates. The existence of a kernel 
in the last product formula 

Me"") Me"") = [ Me") k{H, X, Y) 5{H) dH (1) 
Ja+ 

is equivalent to the absolute continuity of the measure ^x,y with respect to the Lebesgue measure 
on a and to the existence of the density of mx,Y on G, with respect to the invariant measure dg. 
When the formula ([1]) holds, we say that we have a product formula for X and Y E a. Provided 
that X, Y E a^, the product formula ([T]) has been shown previously (see [2] in the rank one case. 
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[3] in the complex case and |1] in the general case). In |1] we were able to relax these conditions 
and show that fix,Y is absolutely continuous provided one of X or F is in a"*" as long as the other 
is nonzero. The density can however exist in some cases when both X and Y are singular. It is a 
challenging problem to characterize all such pairs X and Y. 

This problem was solved in |7] for symmetric spaces with root system of type An- We solve it 
in this paper for the space SOo(p, g)/SO(p) x SO(g): we give a definition of an eligible pair (X, Y) 
(Definition |3]) and next we prove the necessity (Proposition |5]) and the sufficiency (Proposition [5] 
and Theorem [T3|) of this property for the absolute continuity of mx,Y- 

====^By jSJIl], the density k{H,X,Y) exists if and only if Sxx = ci{e^ K e^), the support 
of the measure /ix,y|^, has nonempty interior. Similarly, the density of the measure mx,Y exists 
if and only if its support Ke^ Ke^ K has nonempty interior as seen in [7j. These facts are crucial 
in the proofs of the results of this paper. 

We show in Corollary \TE\ that the result for the space SOo(p, g)/SO(p) x SO(g) also implies 
the result for the spaces SU(p, g)/S(U(p) x U(g)) and Sp(p, g)/Sp(p) x Sp(g). We conclude the 
paper with two further applications of our main result. One of them is a characterization of an 
optimal convolution power / of the measure 5^^^, which is absolutely continuous for any X 7^ 0, 
X E a. Theorem [T7I solves on non-compact Grassmannians a problem raised by Ragozin in |12j . 



2 Basic properties 



We start by reviewing some useful information on the Lie group SOo(p, q), its Lie algebra so{p, q) 
and the corresponding root system. Most of this material was given in [TB]. For the convenience 
of the reader, we gather below the properties we will need in the sequel. 

In this paper, Eij is a rectangular matrix with O's everywhere except at at the position (i, j) 
where it is 1. 



Recall that SO(p, q) is the group of matrices g G SL(p + g, R) such that g Ip^g g 



Ip^q where 



'P>9 



^ . Unless otherwise specified, all 2 x 2 block decompositions in this paper 

follow the same pattern. 

The group SOo(p, (?) is the connected component of SO(p, g) containing the identity. The Lie 
algebra so{p, q) of SOo(p, q) consists of the matrices 



A B 
^ D 

where A and D are skew-symmetric. 

A very important element in our investigations is the Cartan decomposition of so{p,q) and 
SO(p, q). The maximal compact subgroup K is the subgroup of SO{p, q) consisting of the matrices 



A 
D 



of size (p + g) X (p + q) such that A e SO{p) and D E SO(g) (hence K ~ SO{p) x SO(g)). If i 
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is the Lie algebra of K and p is the set of matrices 

5" 


then the Cartan decomposition is given by so(j9, q) = { © p with corresponding Cartan involution 
The Cartan space a C p is the set of matrices 

Opxp T-^H Opx [q—p) 

H = T>H Opxp Opx(g-p) 

. 0('?-p)xp 0(9-p)xp 0{i?-p)x((j-p) _ 

where Vh = diag[ifi, . . . , Hp]. Its canonical basis is given by the matrices 

Ai := Ei.p+i + Ep+i^i, 1 <i <p. 

The restricted roots and associated root vectors for the Lie algebra so(p, q) with respect to a 
are given in Table [H 



root a 


multiplicity 


root vectors Xa 


a{H) = ±Hi 
I < i < p 


q-p 


-^ir ~ Ei2p+r + E2p+ri i (Ep^i2p+r " E2p+rp+i) 

r = 1, q-p 


1 < i,j <P,i<j 


1 


-^{.Eij Eji ~\~ Epj^ipj^j Epj^j pj^j^ -\- Eipj^j -\- Epj^j i 
~\~ Ejpj^i -\- Epj^ij 


a{H) = ±{Hi + H,) 
1 < i,j <P,i<j 


1 


Zj^j ziz(^Eij Eji Epjj-ipj^j -\- Epj^j pj^i^ {^Eipj^j -\- Epj^ji) 

~l~ Ejpj^i -\- Ep_^ij 



Table 1: Restricted roots and associated root vectors 

The positive roots can be chosen as a{H) = Hi ± Hj, I < i < j < p and a{H) = Hi, i = 1, 
■ ■ ■ , P- We therefore have the positive Weyl chamber 

a+ = {H ea: H^ > H2 > ■ ■ ■ > Hp > 0}. 

The simple roots are given by ai{H) = H^ — i/j+i, i = 1, . . . , p — 1 and ap{H) = Hp. 
The action of the Weyl group. The elements of the Weyl group W act as permutations of 
the diagonal entries of Vx with eventual sign changes of any number of these entries. 
The Lie algebra t is generated by the vectors Xa + OX^. We will use the notation 

Xa 

The linear space p has a basis formed hj Ai E a, 1 < i < p and by the symmetric matrices 
X^ := ^{Xa — 9Xa) which have the following form 

Xir : = Ei^2p+r + E2p+r,i; I < t < p, 1 < r < q - p; 
^ij '■ = Ei^p^j + Ej^p^i + Ep^j^i + Ep^ij, 1 ^ ^ < J < 
Zij : = Ei^p^j — Ej^p^i + Ep^j^i — Ep^ij, ^ ^ i < j ^ P- 
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If we followed the notation of [7j, we should write {X^Y, etc. but we simplify the notation to Xir, 
Yij and Zij. If we write a matrix from the space p in the form 



B 




fii B2 
Bf 




where Bi is a square p x p matrix and B2 is a. p x [q — p) matrix, then the matrices 

Si 
Bf 
^ 

are generated by the vectors Ai (for the diagonal entries of Bi and Bf), Yij and Z^j (for the 
non-diagonal entries), whereas the matrices 

^2 



are spanned by the vectors Xir. 

We now recall the useful matrix S G SO{p + q) which allows us to diagonalize simultaneously 
all the elements of o. Let 



r V2 



s 



VZ T 

2 

V2 T 

2 



px(q-p) 
px(q-p) 



L 0(g_p)xp 



Or 



V2 J 
2 '^P 

2 "^P 



where Jp = (5j^p_|_i_i) is a matrix of size pxp. If H 



Vh 
Vh 




with Vff = diag[ifi, . . . ,Hp 



q-p 



then S^HS = diag[ffi, . . . , ifp, 0, . . . , 0, -Hp, -Hi] . 
The "group" version of this result is as follows: 



q-p 



. e e~ 

L, O , . . . , O 



e^^ = diag[e^^...,e^^l,...,l, 

Remark 1 The Cartan projection a{g) on the group SOo{p,q), defined as usual by 

g = kie°'^^^k2, a{g) G a+, ki, k2 e K 

is related to the singular values of g & SO{p,q) in the following way. Recall that the singular 
values of g are defined as the non-negative square roots of the eigenvalues of g^g. Let us write 
H = a{g). We have 



g^ g = fc^ e^^ k2 = (ki S) (5^ e^^ S) (S' k2) 
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where S'^ e^^ S is a diagonal matrix with nonzero entries e^^% . . . , e^^^, 1, . . . , 1, e~^^p, . . . , 
e~^^^. Let us write aj = e^^ . Thus the set of p + q singular values of g contains the value 1 
repeated q — p times and the 2 p values 

Hence, in order to determine a{g), we can compute the p + q singular values of g^g and omit 
q — p values 1 always appearing among them. The 2p remaining singular values may be ordered 
ai > . . . > Up > > • • • > fl]"^ with ai > . . . > Up > 1. Then 



Va^g) 
l^aia) 





with Va^g) = diag[log ai, . . . , log Up] 



Summarizing, if for g G SO(p, g) C SL{p + q) the SL(p + q)-Cartan decomposition writes 
g = kie'^^^^k2, ki,k2 E SO{p + q), then Va(g) = 'Kp{a{g)), where Tip denotes the projection 
7rp(diag[/ii, . . . , hp+g]) = diag[/ii, ...,hp]. 

Singular elements of a. In what follows, we will consider singular elements X, Y E da~^. 
As in [7J, we need to control the irregularity of X and Y, i.e. consider the simple positive roots 
annihilating X and Y. A special attention must be paid to the last simple root ap, different from 
the roots i = 1, ... ,p — 1, that generate a root subsystem of type Ap^i. We introduce the 
following definition of the configuration of X G a+. 

Definition 2 Let X G o+. There exist nonnegative integers si > 1, . . . , Sr > I, u > such that 

SI S2 Sr ^ " ^ 

Vx = diag[ 'xi,.^. ,Xi,''x2,.^. ,X2, . . . /x^, 0, . . . , ] 

with xi > X2 > ■ ■ ■ > Xr > and Si + u = p. We say that [si, . . . ,Sr',u] is the configuration of 
X . Writing s = (si, . . . , Sr), we will shorten the notation of the configuration of X to [s; u]. We 
will also write X = X[s;u]. 

Note that X = is equivalent to u = p and has configuration [0;p]. A regular X G a"*" has the 
configuration [1;0] = [1^;0]. We extend naturally the definition of configuration to any X G a, 
whose configuration is defined as that of the projection vr(X) of X on a+. 

In what follows, we will write maxs = maxj Sj and max(s,'u) = max(maxs,'u) . We will show 
that in the case of the symmetric spaces SOo{p,q)/SO{p) x SO(g), q > p, the criterion for the 
existence of the density of the convolution is given by the following definition of an eligible 

pair X and Y: 

Definition 3 Let X = X[s; u] and Y = Y[t; v] be two elements of a. We say that X and Y are 
eligible if 

max(s, 2u) + max(t, 2v) < 2p. 
Observe that if X and Y are eligible, then X 7^ and Y ^ 0. 
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3 Necessity of the eligibility condition 



In the proof of the necessity of the ehgibihty condition we will use the result stated in [HI Step 1, 
page 1767]: 

r N-s 

Lemma 4 Let U = diag([uo, . T. , uq, Ui, . . . ,UN-r] O'nd V = diag([i;o, - ^ ■ ,Vo,Vi, . . . , Vg]. where 
s+1 < r < N , s > 1, and the Ui 's and vj 's are arbitrary. Then each element ofa{e^ SU(A^, F) e^) 
has at least r — s entries equal to uq + vo- 

We will use Lemma H] with N = p + q in the proofs of Proposition |5] and Theorem [T71 

Proposition 5 If X[s;u] and Y[t,v] are not eligible then the measure nxy is not absolutely 
continuous with respect to the Lebesgue measure on a. 

Proof: Suppose max(s, 2 m) + max(t, 2v) > 2p and consider the matrices a{e^ k e^), k G SO(]9) x 
SO(g). Applying Remark [H the diagonal p x p matrix V^^e^ ke^) contains the p biggest diagonal 
terms of the matrix 

li u + v > p then there are r — s = r + (A^ — s) — N = {2u + q — p) + {2v + q — p) — {p + q) = 
2 [u + V — p) + {q — p) repetitions of + = in coefficients of d{e^ke^). Therefore occurs at 
least u + V — p > times as a diagonal entry of Vh for every H G a{e^ K e^) which implies that 
a(e^ K e"^) has empty interior. 

If 2m + max(t) > 2p denote t = max(t). Let Yi ^ he repeated t times in "Dy. Then there 
are r — s = r + {N — s) — N = {2u + q — p) + t — {p + q) = 2u + t — 2p repetitions of + in 
coefficients of a{e^ke^). Therefore Yi occurs at least 2u + t — 2p>0 times as a diagonal entry of 
Vh for every H G a{e^ K e^) which implies that a{e^ K e"^) has empty interior. I 



4 Sufficiency of the eligibility condition 

We use basic ideas and some results and notations of |7^ Section 3]. 

Proposition 6 (i) The density of the measure mx,Y exists if and only if its support Ke-^Ke^K 
has nonempty interior. 

(a) Consider the analytic map T: K x K x K ^ SOo(p, q) defined by 

T{ki, k2, ks) = ki k2 <^ k^. 

If the derivative ofT is surjective for some choice o/k = (fci, ^2, ks), then the set T{K xK x K) = 
Ke^ Ke^ K contains an open set. 

Proof: Part (i) follows from arguments explained in [3] in the case of the support of the measure 
/^x,y, equal to a{e^ Ke^). Part (ii) is justified for example in [TOl p. 479]. I 
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Proposition 7 Let Uz = i + Ad{Z)t. If there exists k ^ K such that 

U.x + Ad{k)UY = 9 (2) 
then the measure mx,Y is absolutely continuous. 

Proof: We want to show that the derivative of T is surjective for some choice of k = {ki, k2, k^). 
Let A, 5, C e t. The derivative of T at k in the direction of {A, B, C) equals 



dT^{A,B,C) = ^1, „ e*^A;ie^e*^fc2e^e*^fc 



dt 



3 



= Akic^ k2 ks + kie^ B k2 fcg + ki fca C h (3) 

We now transform the space of all matrices of the form ([3]) without modifying its dimension: 

dim{A ki k2 k^ + kie^ B k2 k^ + ki ^2 C k^: A,B,C e t} 
= dim{k^^ A ki k2 + e^B k2 + k2e^ C : A, B,C e t} 
= dim{Ae^ k2 + B k2 + k2e^ C : A, B,C e t} 
= dim{e-^ Ae^ + B + k2e^ C e'^k^^ : A,B,C et} 

The space in the last line equals t + Ad{e~^){i) + Ad{k2) (Ad(e^)(«)) = U-x + Ad{k2)UY. ■ 

In order to apply the condition ([2]), we will consider convenient root vectors and their sym- 
metrizations. For Z G a, we define the space 

Vz = span{X^ I a(Z) ^ 0}, 

where = — OXa- Note that this space would be called in the notation of [7]. 

Lemma 8 Let Z & a. The vector space Uz = t + Ad{e^){t) contains the root vectors X^ for which 
Oi{Z) 7^ 0. ====^ Consequently , Vz = V-z C U±z-"'^==== 

Proof: ====^Suppose a is a root such that ol{Z^ ^ 0.<^=====Note that [Z^Xc] = a{Z) X^ 
and [Z, e{X^)] = -a{Z) e{X^) . Let U = X^ + 9{X^) e t Now, 



Ad(e^) U = e^d^ (X. + e{X^)) = (X. + e{x^)) 



k=0 

oo 



(adZ)^ , (adZ)^ 

fc=0 A,-0 



k=0 ' k=0 

Therefore X« = (e°(^) -e-"(^))-i (-e-"(^) U + Ad(e^) U) E « + Ad(e^)({) = Uz- The vector OX^ 
is a root vector for the root —a, so we also have OX^ € Uz- I 
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Proposition 9 // there exists k G K such that 

Vx + Ad{k) Vy = p (4) 
then the measure mx,Y is absolutely continuous. 

Proof: We want to prove formula ([2]). By Lemma [HI we know that Vx = V-x C U-x and 
Vy dVy. As € C t/x, we see that the formula (jl]) imphes ([2]). ■ 

Later in this section. (Theorem [T3|) . we will show that the hypotheses of the last Proposition 
are always satisfied for X and Y eligible. For technical reasons, in order to make an induction 
proof work, we will show more, i.e. that a "better" matrix k & K exists such that the formula 
dl]) holds. The meaning of a "better" k will be similar to the notion of a total matrix given in 
Definition [TOl Here is a definition and a lemma about total matrices in K. The reasonning of 
the proof of this lemma will be used in a more general setting in Steps 2 and 3 of the proof of 
Theorem [131 

Definition 10 We say that a square n x n matrix k is total if by removing any r < n rows and 
r columns of k we always obtain a nonsingular matrix. 

Note that this definition of totality is more restrictive than in [TJ Definition 3.7]. 

Lemma 11 The set of matrices in SO(n) which are total is dense and open in SO(n). 

Proof: Consider first the set Mj^j = M{jj^ j,,} C SO(?2) of orthogonal matrices which 

remain nonsingular once the rows of indices ii, . . . ,ij and the columns of indices ji, ■ ■ ■ ,jr are 
removed. To see that such matrices exist, take the identity matrix (whose determinant is 1 if we 
remove, say, the first r rows and columns). By taking convenient permutations of the rows and 
columns of the identity matrix, we obtain an element of Mj^j. Given that SO{n)\Mi^j corresponds 
to the set of zeros of a certain determinant function, it must be closed and nowhere dense in SO(?t,). 

To conclude, it suffices to notice that the set of total matrices in SO(?7,) is the finite intersection 
of all the sets Mj- j. ■ 

In the proof of the main Theorem [13] we will need the following technical lemma. 
Lemma 12 (i) For the root vectors X^, Z^, , we have 

cos{2t)Xir + 2 sin(2t) Aj, 
cos(4t) Yij + 2 sin(4t) {Ai - Aj), 
cos(4t) Zij + 2 sin(4t) (A + Aj). 

(ii) The functions Adi^e^^-^i^^^-^i^^), Adi^e*"^^^^^^^^^^) and Ad{e^^^^^'^^ ^^^^) applied to the other sym- 
metrized root vectors do not produce any components in a. 



^^(e*(^.^+e^^))(X,,) = 
^^(e*(>'.T+^^^))(K,,) = 
^d(e*(^^.+ +^^5))(%) = 
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Proof: It is just a matter of carefully evaluating 




fc=0 



For (ii), use the well known properties of the root system: [g^, g^] G g^^^ and [X^, Go. I 

By Proposition [9l in order to justify the sufficiency of the eligibility condition, it is enough to 
prove the following theorem. This is the main result of this section. 

Theorem 13 Let G = SOQ{p,q) and let X, Y E a. If X and Y are eligible then there exists a 
matrix k E K such that 



Proof: We will assume that X = X[s;u] and Y = Y[t;v]. Observe that the spaces Vx and Vy 
depend on the Weyl chambers where X and Y belong. However, see \T, Lemma 3.3 and Reduction 
1, p. 759], the property ([5]) is equivalent to Ku^x + Ad(A;') Vw2Y = P for any wi,W2 G W and a 
convenient k' G K. Throughout the proof we will assume that the diagonal entries of Vx and Vy 
are non-negative and we will arrange (permute) them conveniently. 

To lighten the notation, for a matrix c of size p x q, we will consider the {p + q) x [p + q) 
symmetric matrix 



The proof will be organized in the following way: 

1. Proof for q = p + 1 using induction on p 

(a) Proof for p = 2 and g = 3 

(b) Proof of the induction step 

i. Proof in the case -u > or > 

ii. Proof in the case X[p; 0], Y[p; 0] 

2. Proof that the case (p, q) implies the case (p, q + 1). 

1. Proof for q = p + 1 using induction on p 

(a) Proof for p = 2 and q = 3 

This corresponds to the space SOo(2,3). Only two configurations [2; 0] and [1; 1] may be 
realized by singular non-zero X and Y. When Z G o"*", we have 'C'z^i;!] = diag[2, 0], and 'Dz[2fi] = 
diag[2;, z], z ^ 0. It is easy to check that in all 3 possible cases: 



Vx + Ad{k) Vy = p. 



(5) 



c 




G p. 



(0 X[2; 0],Y[2; 0] (n)X[2; 0], Y[l; 1] orX[l; 1], y [2; 0] (m)X[l; 1], 1], 
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X and Y are eligible. Note that 



If ki = 



\/2/2 







yZ[2;0] = 

^Z[l;l] = 

-\/2/2 

v/2/2 




hi a h 
c h2 d 

a b 
—a c 

a c 
6 



: hi, /i2, a, 6, c, d e R 
: a, 6, c e R 
a, 6, c e R 












1 
V2/2 

^/2/2 V2/2 



then 



Ad(A;i) Vz[2;o] 



and 



Ad(A;i) Vz[i;i] 



If 



v^/2 
72/2 









-v^/2 
V2/2 









Ad(A;2) Vzii-i] 



y2a/2 (a-6 + c)/2 (a + 6-c)/2 
-V2a/2 {a-b-c)/2 {a + b + c)/2 



-V2b/2 (a-c)/2 (a + c)/2 
a/2 6/2 (a-c)/2 (a + c)/2 







\/2/2 -^2/2 then 

1 

V2/2 v^/2 



-{b + c)/2 y/2a/2 {-b + c)/2 
{b-c)/2 \/2a/2 {b + c)/2 



: a, 6, c e R 



a, 6, c e R 



a, 6, c e R 



We verify easily that in the cases (i) and (iii) we have + Ad(A;i) Vy — p. For X[2; 0] and Y[l; 1], 
we can see that Vx + Ad{k2) Vy — p. 

(b) Proof of the induction step 

(i) Proof in the case m > or f > 

We consider the space SOo(p, p + l)/SO(p) x SO(j9 + l) with p > 2 and the case when X[s;m] 
and i^[t;t'] are such that m > or u > 0. We assume u > v. We choose the predecessors in 
SOo(p - l,p)/SO(p - 1) X SO(p) in the following way: 

X' = X'[s;u-1], Y' = Y'[t';v] 

where t' means that we supress one term from the longest block of size maxt. Note that if p > 2 
then t' is not the zero partition (otherwise, t would have been the partition [1] meaning that 
u > V — p — 1 which would make X and Y ineligible) . 
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We arrange X, X', y, Y' in the following way. 
1. The first diagonal entry of Vx is zero and all the other zeros are at the end. The diagonal 
entries of Vx' are those of Vx without the first zero: 



7^0 



M-1 



7^0 



u-l 



Vx = diag[0, xi, . . . , Xp_„, 0, . . . , 0], Px' = diag[xi, . . . , Xp_„, 0, . . . , 0] 

2. We put a longest block of size t of equal diagonal entries yi of I^y in the beginning of Y. 
The diagonal entries of Vy' are those of with the first entry omitted: 

t t-i 
Vy = diag[^77^'r^~ii, ?/2, • • • , l/s] , Vy> = diag[yT^''^'~y^, ?/2, • • • , • 

It is easy to check that if X, Y are eligible in SOo(p, p + 1) then X', Y' are eligible in 
SOo(p-l,p). 

Step 1. By the induction hypothesis, there exists a matrix ko G SO{p — 1) x SO{p) such that 



Vx' +Adiko)Vy> =p'. 
We embed K' = SO{p — 1) x SO{p) in SO{p) x SO{p + 1) in the following way 

1 



(6) 



K' 



SO{p-l] 



1 



c 



SO(j9) 



SO{p) 

Hence, we have (taking the natural embedding of p' into p) 



SO(p+l) 



V, := Vx' + Adiko)Vy> = p' 



B' 
B'^ 



(7) 



where B' 



' Oixl 


Olxp 


Opxl 


^(p-l)xp 



and -B" is arbitrary (note that p' is of dimension (p — We 
must show that for some k E K, the space Vx + Ad{k) Vy = p, i.e. that 

(i) Vx + Ad(A;) Vy contains p' embedded into p as in (I7j). 

(ii) Vx + Ad{k) Vy contains all the matrices of the form 





* 


* ... * 




* 




c = 




0(p— l)xp 








* 





New vectors in Vx and Vy. In order to prove the induction conclusion, we must now use the 
elements of Vx and Vy which do not come from Vx' or Vy. They appear by the interaction of, 
respectively, the first diagonal entry of Vx with the others of Vx and the interaction of the first 
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entry of Vy with the others of Vy- We see that the new independent root vectors in Vx and Vy 
are respectively 

Nx = {Yij,Z,„j = 2,...,p+l-u}, Ny = {Xi,Yu,i = t + l,...,p, =2...,p} 

where t = maxt > 1 and we wrote Xi for Xn. Note that Nx has 2p — 2u elements while Ny has 
2p-t. 

Step 2. We show that there exists k'^ G SO(p — 1) x SO{p) for which ^ holds, and with the 
following property: 

The space V2 := Ad{kQ)span{Ny) is of dimension 2p — t and its elements can he written in the 
form 








a,- ai . . 












Ts 


























(8) 



with r = [(t—l)/2], s = t—l—r, G R arbitrary, ai = crj(ai, . . . , a2p-t) and Tj = Tj{ai, . . . , a2p-t), 
i < r, j < s. 

We will not need to write explicitely the functions cxj and tj. Note that s = r if t is odd and 
s = r + 1 if t is even. 

To justify Step 2, we write 



ko 



1 



01 



02 



where /cqi ^ SO(p — 1) and ko2 G SO{p). Let ai, . . . , ap_i be the columns of the matrix /cqi and 
Pi, . . . , Pp the columns of the matrix A;o2- A simple block multiplication to compute the action of 
Ad(A;o) on the elements of Ny gives the linearly independent matrices 



Ad(A;o)Xi 



' 




_ 






, Ad{ko)Yu = 
Adiko)Zu 

























t + 1, 

^ = 2, 



(9) 



Let us write /?,■ for a column /3j from which we have removed the first r entries and for a 
column ai with the first s entries omitted. In order to prove the statement of Step 2, we must show 
that the matrices obtained by replacing /3i by (3'i and ai by a'i in (jO]) are still linearly independent. 
This is equivalent to the linear independence of the matrices 






/3f " 








" 














" 








t,...,p-l. (10) 
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We will reason in the same way as in Lemma [TTJ 

It is enough to show that there exists at least a choice of matrices fcoi and fco2 such that the 
matrices in ffTOj) are linearly independent. Then, as in Lemma [TT| it will follow that such matrices 
form a dense open subset in SO{p — 1) x SO(p). By choosing /cq with the matrices in flTUl) linearly 
independent and close enough to /cq, the property will be preserved for /cq. 

Pick koi = which implies that = for i = 1, . . . , s and a[ = ej_<j for i > s. With this 
choice, (fTOj) becomes 



' 


/3f 1 









i = 1, 






/3f " 


^i—s 






i = s + 1, . . . ,t - 1, 



" 


/3f 




















s 






, i = t,...,p, 
i = t,...,p-l 



which are linearly independent provided that 



' 


/3f 1 


_ 






l,...,s. 



" 


/3f 1 









t,...,p 



are linearly independent. This is the case for a total matrix ko2 G SO(p) or by taking convenient 
permutations of the rows and columns of the identity matrix Ip. 

Step 3. We show that there exists a proper subset N'-^ of Nx such that, if 



then dim 



pq — 1 = 



= span(A^^) + Vx' + AdiQVy = span(A^^) + V1 + V2 
dimp — 1 and V3 is given by 










CLl 0,2 ... dp 


= < 














P' 






0'2p-l 





ai, . . . a2p_i € R > 



Note that in matrices from the space V2, there are r = [{t — l)/2] pairs {ai, Ti) plus possibly an 
extra if t is even and therefore s = r + 1. Note also that t + 2u < 2p implies that p — u>s>r. 



For j < r < p 



u. 



each pair Yj 
















T 1 









lit 


is odd, all the 



of elements of 



X 



taken care off and at least 2 elements of Nx will remain off N'-^. If t is even, all the aj and r^'s, 
1 < J < ^ will be replaced by independent variables and only will remain. Now, letting the 
coefficient ai "vis-a-vis" the remaining be equal to 1 and all the other variables a, equal to 0, 
either = 1 or — 1 or r<j 7^ ±1. If = 1 then Zis allows us to introduce the missing independent 
variable, if = —1 then adding Yis to N'x will do the trick. In the case Tg 7^ ±1 we choose 
indifferently between Yis and Zig. In all cases the set Nx \ N'-^ has at least one element. 

Step 4. Let vi be the positive root vector corresponding to an element of Nx \ N'x ■ We denote 
= Kji ■ There exists e > such that for t G (0, e) 



Ad(A;*i)(span(Arj,) + Vx') + Ad(A;;)W = V^. 
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Observe that vi is equal to Z{^j or Y{j for one of the remaining Zij or Yij that was not used in 
the preceding step. The space C for all t according to Lemma [T2l (ii). 

Recall the definition of = e^^^°'^^^°'\ t > 0. Let d(t) = dimV^; for t = we have fc^ = Id, 
and Ad(A;5')(span(A^^) + Vx') + Ad(fco)VY = V3 is of dimension pq — 1, so d{0) = pq — 1. The 
equality d{t) = d{0) is equivalent to non-nullity of an appropriate determinant continuous in t. 
Thus d{t) = pq — 1 holds for t G (0, e) for some e > 0. As I4* C V^, the statement of Step 4 
follows. 

Step 5. Generation of Ai. By Lemma [T2| we have Ad{k\)vl = atvf + btAi + ctAj with j 7^ 1 and 
6t 7^ for t G (0, e) with e small enough. Consequently 

Ad(A;i)span(i;i) + = p. 



Conclusion. We have p = Ad{k{){Rvf + spaniV^ + Vx') + Ad(A;^)Vy C Ad(A;*)Vx + Ad(A;())W, 
so Ad{k{)Vx + Ad{k'Q)VY = p. It follows that 

Vx + Adiik{)-X)Vy = p. 



(ii) Proof in the case X[p] 0], Y[p; 0] 

This case must be treated separately because the predecessors X', Y' and consequently the 
sets Nx and Ny are different than in case (i). The structure of the induction proof is identical as 
in (i), with the Steps 2 and 3 executed together. 

We choose both predecessors X'[p — 1]0], Y'[p — 1; 0] and arrange X, X' ,Y,Y' in the same 
way as we did in the first part of the proof with y[t;f] and y[t';w]. In that case, Nx = 
{Xi, Z12, ■ ■ ■ , Zip} = Ny and the space Ad(/co)(A^y) is generated by 






PI' 


_ -cti 






1, ... ,p — 1 and 



" 











(12) 



Recall that 






T 


. -^3-1 






(13) 



We want to show that the matrices in f[T^ together with those of f[T^ are linearly independent 
for a fed G SO(p — 1) X SO(p) for which the equality ([6]) holds. Note that if k'^ = ^^^^ 



{p odd) or /cq 







L 



{p even) then the matrices f|T2|) and f|T3|) are linearly independent. 



-.p 

Using once more the reasonning in Lemma [11], this implies that the set of matrices k'^ for which 
this is true, is open and dense in SO{p — 1) x SO(p). 

We conclude that if A^^ = Nx\{Xi} then span (A^^ + Vx') + Ad{kQ)VY has the form given in 

We reproduce the previous Step 4 and Step 5 using vi = X^. The rest follows. 



2. Proof that the case {p, q) implies the case (p, g + 1) 
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====^We will show by induction that for any q > p, there exists a matrix k G K such that 
dS]) holds. <^=====We know by the first part of the proof that this is true for SOo(p, p + 1). 

Assume that X and Y are eligible in SOo(p, q+1)- Their configurations are ehgible in SOo(p, q). 
We write X', Y' when we work in SOo(p, q)- 

We embed K' = SO{p) x SO(g) in K = SO{p) x SO(g + 1) in the following way 



K' 



SO(p) 



SO(g) 



c 



SO{p) 



SO(g + l) 



The space p' is formed by matrices 



B 




where B are p x q matrices. We embed p' in p by adding a last column of zeros to B. 
Step 1. We suppose that there exists a matrix ko G K' such that 

Vx'+Ad{ko)VY'=p'. (14) 

Then, by [H Lemma 3.3], for any permutations Si and S2 of the diagonal entries of Vx' and 
Py/, there exists ko G K' such that 

Vs,x' + Ad{ko)Vs,Y' = p 

so we can permute the elements of X' and Y' in a convenient way and still have the equality ([1 
We will arrange them in the following way (where the stars denote nonzero entries): 



Vx' = diag[Oy^. . ,0,*, . . . Py/ = diag[*, 0, . .To]- 

Let us denote fcoi ^ SO(p) and ko2 G SO(g) the matrices compositing ko corresponding in (H^j) to 
such X' and Y'. We can suppose that the matrix koi is total. 

By the eligibility of X and Y , u + v < p, so no two zeros in Vx' and are at the same 
position. 

Let N = {X,,g+i}tv We set Nx := Vx n N = {X^+1,,+1, . . . , Ny := Vy n N = 

{Xi^g+i, Xp_^^q+i}. We have p - v > u. 

Step 2. Let 

koi 

ki = ko2 

1 

where /cqi G SO(p) and fco2 G SO(g) are the blocks compositing ko. We then have 

Vx' + Ad{k^)VY' = [ p' (15) 

The space Vx + Ad(A;i)Vy contains, in addition to the matrices in flT^ . the linear span of 
Nx + Ad{ki)NY. 
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Denote the columns of the matrix /cqi by Ci, . . . , c^. By block multiplication in SOo(p, q + 1), 
we obtain 

Ad{ki)Xj^g+i = [ Opxg Cj Y . 
This implies that the linear span of A^x + Ad(/ci)A^y contains the following symmetric matrices: 

[ Opxg ] )■■■)[ Opxq Cu ] , [ Opxq ] )■■■)[ ^pxq ] j 

which are linearly independent by the totahty of /cqi- Thus Vx + Ad{ki)VY — p- t 



We conclude this section with an example to illustrate our proof. 

Example 14 Consider X — X[2;1\,Y = Y[l,l;l] m 5o(3, 4). We write X and Y in such a way 
that Vx — diag[0, a, a] and Vy — diag[fe, c, 0]. Their predecessors in so(2, 3) are X' and Y' such 
that Vx' = diag[a, a] and Vy = diag[c, 0] . 

Note that X and Y form an eligible pair and so are X' = X[2; 0] and Y' — Y'[l; 1]. In Step 1, 

" 1 " 
ko,i 
10 
A;o2 



we show that there exists a matrix ko — 
such that 

Vx' + Ad{ko) Vy 



with koi e SO (2) and /co,2 G SO (3) 




* * * 
* * * 



where * designates an arbitrary element. We have 

Nx = {Zu, Yu, Zi3, Fia}, Ny = {X,, Z^, Y^, Z^, Y,s}. 
In Step 2, we observe that 



Ad{ko)spein{Ny) = 



■ 


0,1 0,2 ^3 


a4 




05 






, Qi, . . . Qg G R 



since the matrices 






PI] 


s 





PI] 


s 





PI] 


s 





PI] 


s 


" 


PI 


— «! 














—Oi2 







_ Oi2 














are linearly independent. Note that in this case, there are no and no Ti. 

Nx Ny 



Now, Vx = span{Zi2,Yi2,Zi3,Yi3}UVx' while Vy = span {Xi, Z12, Z13, Zi4,Yi3}UVy> . We 
can show that 

Ad{e^^^t^+^^t2))(yx') + Ad{ko) {spanNy U Vy>) 

* * * 

* * * * 

* * * * 
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fort small enough (with t small enough, the dimension will not decrease). Now, 



CVx 



Vy 



Ad{e'''^t2+(>K2)) {span{Zi2} U Vx') + Ad{ko) {spanNYUVv) 



* * * * 

* * * * 

* * * * 



ift close to since yl(i(e*(^i+^^i))(^^2) = cos(4t) Z12 + 2 sin(4t) {Ai + A2). Therefore, 



k 



which means that the density exists. 



5 Applications 

=====^We now extend our results to the complex and quaternion cases. <^===== 

Recall that SU(p, q) is the subgroup of SL(p + q, C) such that g* Ip,qg = Ip,q while Sp(p, q) 
is the subgroup of SL(p + g, H) such that g* Ip gg = Ip^g. Their respective maximal compact 
subgroups are S(U(p) x U(g)) and Sp{p) x Sp(g) = SU(p, H) x SU(g, H). 

B 
B* 



Their subspaces p can be described as 



where B is an arbitrary complex (respectively 



quaternionic) matrix of size px g. The Cartan subalgebra a is chosen in the same way as for so{p, q). 

Corollary 15 Consider the symmetric spaces SOo(p, g)/SO(p) x SO(g), SU(p, g)/S(U(p) x 
U(g)) and Sp{p, q)/Sp{p) x Sp(g), q > p. 

Let X,Y e a. Then the measure 6 x ^ y is absolutely continuous if and only if X and Y are 
eligible, as defined in Definition\^ 

Proof: Let X, y G o. If they are eligible then since 

a(e^ (SO(p) X SO(g)) e^) C a(e^ S(U(p) x U(g)) e^) C a(e^ (Sp(p) x Sp(g)) e^), 

it follows from Theorem [T3l that these sets have nonempty interior. Hence the density exists in all 
three cases. 

On the other hand, given Lemma HI one can reproduce Proposition [S] using F = C and F = H 
to show that the eligibility condition is necessary in the complex and quaternionic cases. I 

We will conclude this paper with two further applications. 

Proposition 16 Let X and Y E a be such that (^^^x^ one? (^^1^^ '^^^ absolutely continuous. 
Then 6''^x * is absolutely continuous. 
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Proof: =====^Let X = X[s]u] and Y = F[t; i;].4=====We know that the couple {X,X) is 
eligible; therefore 



2 max{s, 2u} < 2p. 
In the same manner, max{t, 2v} < p. Hence, 

max{s, 2u} + max{t, 2v}<p + p = 2p 
which means that X and Y are eligible. Consequently, * is absolutely continuous. ■ 

If X E a and X 7^ 0, it is important to know for which convolution powers I the measure 

is absolutely continuous. This problem is equivalent to the study of the absolute continuity of 
convolution powers of uniform orbital measures 5^ = rriK * Sg * rriK for g ^ K. 

It was proved in [HI Corollary 7] that it is always the case for I > r + 1, where r is the rank 
of the symmetric space G/K. It was also conjectured ([HI Conjecture 10]) that r + 1 is optimal 
for this property, which was effectively proved for symmetric spaces of type v4„([Hl Corollary 
18]). In the following theorem, the conjecture is shown not to hold on symmetric spaces of type 
====^i?p<^=====, where r = p. Thanks to the rich structure of the root system Bp, already 
all p-th powers of orbital measures are absolutely continuous and p is optimal for this property. 

Theorem 17 On symmetric spaces SOo{p,q)/SO{p) x SO(g), SU(p, g)/S(U(p) x U(g)) and 
Sp(p, g)/Sp(j9) X Sp(g), q > p, for every nonzero X E a, the measure (S^^xY is absolutely contin- 
uous. Moreover, p is the smallest value for which this is true: if X has a configuration [l;p — 1] 
then the measure (5^^)^"^ is singular. 

Proof: We will write 5*^ for the set a{e^ K . . . ,K e^) where the factor appears / times. Note 
that (5gx)' is absolutely continuous if and only if Sx has nonempty interior. 

We prove first that for / < p, the measure {S^Y may not be absolutely continuous. Let 
X = X[l]p — 1]. Using Lemma m repeatedly, as in the proof of Proposition El we show that for 
/ < p, there are at least p — I diagonal entries of Vh which are equal to for every H G Sx- 
Consequently, Sx has empty interior and {S'^xY is not absolutely continuous when I < p — 1. 

We will now show that (^^x)^ has a density for every X 7^ 0. 

If X = X[s;0] then the measure {S^^xY is already absolutely continuous (the couple (X, X) is 
eligible). Suppose then that X = X[s; -u] G o+, -u > 0. 

Remark that if H e Sx then a{e^ Ke") C Indeed, we have e^kiE^ ... k^ic^ = 

ka kb and therefore a{e^ K e^) = a{e^ K ka h) = a{e^ K ki . . . k^i e^) C 

We claim that there exists H G S^x^ such that H = H[1p~^; 1] ot H E 

We prove the claim using induction on p. If p = 2 then 5*^"^ = {X} and the result follows (in 
that case, u cannot be higher than 1 for X 7^ 0). 

rso(p-i) " 

Suppose that the claim is true for n — 1 > 2. Let Kn = ^ r. c^r^/ ^\ r, 

SO(g — 1) 

1 

Consider the set B = a{e^ Kqc^ . . . e^) with p — 1 factors . By the induction hypothesis, 
there exists Hq E B with Hq = HqII^^"^; 2] or Hq = Hq[1p^^; 1]. In the second case, we are done. 
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If Ho = ifo[l^^^; 2] G B, we can assume that the diagonal entries which are in Vx and in 
Hq are at the end. We note that X and Hq considered without their last entries are eligible in 
SOo(p — 1, Q' — 1), their configurations being [s; u — 1] and 1] respectively. Hence a{e^ Kq e^°) 
has nonempty interior in the subspace a+ fl {Hp = 0}. Therefore, there exists H G a(e^ Kq e^°) C 
S^x^ with H = H[1P-^; 1] which proves the claim. 

To conclude, we take H G 5"^"^ with H E oi H = 1]. In both cases, X and H are 

eligible, so by Corollary [T5] the set a{e^ K e^) has nonempty interior. As a{e^ K e^) C S^, this 
ends the proof. I 

6 Conclusion 

With this paper and with [7J, we have now obtained sharp criteria on singular X and Y for the 
existence of the density of 6\ * for the root systems of type An and type Bp. Thanks to [8] 
and Theorem [T7] of the present paper, sharp criteria are now given for the Z-th convolution powers 
(S^xY to be absolutely continuous for any X 7^ 0, X G o. 

Although there is considerable similarity between the criteria for both type of spaces, a char- 
acterization of eligibility that would be applicable for all Riemannian symmetric spaces of non- 
compact type has yet to emerge. The solution of the second problem in Theorem [17] seems to 
indicate that the answer may depend on the type of the symmetric space. 
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